Rapid advances in computing and robotics have led to calls for government controls. Before acting, we need to distinguish among the many meanings and applications of the technology. New technologies often spur public anxiety, but the intensity of concern about the implications of advances in artificial intelligence (AI) is particularly noteworthy. Several respected scholars and technology leaders warn that AI is on the path to turning robots into a master class that will subjugate humanity, if not destroy it. Others fear that AI is enabling governments to mass produce autonomous weapons--"killing machines"--that will choose their own targets, including innocent civilians. Renowned economists point out that AI, unlike previous technologies, is destroying many more jobs than it creates, leading to major economic disruptions. There seems to be widespread agreement that AI growth is accelerating.

One employee traveling for work checked his dog into a kennel and billed it to his boss as a hotel expense. Another charged yoga classes to the corporate credit card as client entertainment. A third, after racking up a small fortune at a strip club, submitted the expense as a steakhouse business dinner. These bogus expenses, which occurred recently at major U.S. companies, have one thing in common: All were exposed by artificial intelligence algorithms that can in a matter of seconds sniff out fraudulent claims and forged receipts that are often undetectable to human auditors -- certainly not without hours of tedious labor. AppZen, an 18-month-old AI accounting startup, has already signed up several big companies, including Amazon, International Business Machines, Salesforce.com and Comcast, and claims to have saved its clients $40 million in fraudulent expenses.

One employee traveling for work checked his dog into a kennel and billed it to his boss as a hotel expense. Another charged yoga classes to the corporate credit card as client entertainment. A third, after racking up a small fortune at a strip club, submitted the expense as a steakhouse business dinner. These bogus expenses, which occurred recently at major U.S. companies, have one thing in common: All were exposed by artificial intelligence algorithms that can in a matter of seconds sniff out fraudulent claims and forged receipts that are often undetectable to human auditors--certainly not without hours of tedious labor. AppZen, an 18-month-old AI accounting startup, has already signed up several big companies, including Amazon.com Inc., International Business Machine Corp., Salesforce.com

Operational AI systems (for example, self-driving cars) need to obey both the law of the land and our values. We propose AI oversight systems ("AI Guardians") as an approach to addressing this challenge, and to respond to the potential risks associated with increasingly autonomous AI systems.a These AI oversight systems serve to verify that operational systems did not stray unduly from the guidelines of their programmers and to bring them back in compliance if they do stray. The introduction of such second-order, oversight systems is not meant to suggest strict, powerful, or rigid (from here on'strong') controls. Operations systems need a great degree of latitude in order to follow the lessons of their learning from additional data mining and experience and to be able to render at least semi-autonomous decisions (more about this later).

Operational AI systems (for example, self-driving cars) need to obey both the law of the land and our values. We propose AI oversight systems ("AI Guardians") as an approach to addressing this challenge, and to respond to the potential risks associated with increasingly autonomous AI systems.a These AI oversight systems serve to verify that operational systems did not stray unduly from the guidelines of their programmers and to bring them back in compliance if they do stray. The introduction of such second-order, oversight systems is not meant to suggest strict, powerful, or rigid (from here on'strong') controls. Operations systems need a great degree of latitude in order to follow the lessons of their learning from additional data mining and experience and to be able to render at least semi-autonomous decisions (more about this later).